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INTRODUCTION  AND  SUMMARY 


The  findings  in  this  report  are  directed  toward: 

1.  Identifying  and  documenting  the  Scientific  and  Technical 
Information  (S&TI)  and  Research,  Development,  Test,  and 
Evaluation  (RDT&E)  management  information  requirements  of 
the  Department  of  Defense  (DoD)  RDT&E  community  for  the 
1978-1988  period. 

2.  Identifying  user  problems  associated  with  acquisition  and 
application  of  S&TI/RDT&E  management  information  provided 
by  DDC  or  other  Government  or  non-Government  sources. 

This  User  Survey  Report  is  one  of  five  major  portions  of  AUERBACH *s  long 
range  planning  study  for  DDC.  The  other  four  are:  a Literature  Survey,  an  Expert 

Panel  Review,  an  Interagency  Survey  and  an  Internal  Review  of  DDC  Plans  and  opera- 
tions. The  findings  of  all  five  facets  of  the  study  will  be  combined  in  a sub- 
sequent final  report. 

1.1  SUMMARY  OF  FINDINGS 


Current  Reauix’&nente 

s Local  libraries  are  the  primary  formal  source  of  Information, 

while  "distant"  libraries  are  preferred  by  a very  small  minority 

• Technical  reports  are  preferred  to  other  formats  for  Information 
presentation 


Variation  in  information  requirements  is  strongly  dependent  upon 
Job  type,  l.e.,  bench  level,  management  or  support 


• Ptinted  media  are  preferred  to  computer  printouts  and  microforms 

e Users  will  not  pay  for  Information  services  unless  the  quality  of 
service  Is  substantially  Improved  and  targeted  toward  their  pre- 
c:i8e  needs. 

e Increases  beyond  the  current  level  of  response  time  are  unacceptable 

e DDC  services  are  seen  as  no  better  or  worse  than  those  provided 

by  a specific  comparable  source,  such  as  a service  provided  by 
NASA  or  NTIS 

• Support  personnel  reported  a significantly  higher  rate  of  Informa- 
tlon  Analysis  Center  (lAC)  utilization  than  bench  level  or  manage-  . 
ment  personnel  but  total  lAC  usage  is  low. 

Current  Problem 

• DDC's  lUXT&E  management  information  services  require  more  improve- 
ment than  S&TI  services 

• Most  users  are  unaware  of  tiie  full  range  of  DDC  services. 

• Major  problems  In  information  access  and  use  are  quality,  response 
time,  quantity  and  up-to-dateness,  in  that  order. 

e Minor  problem  areas  are  in  information  presentation  (formats  and 
media) 

Prediated  Fecmi-^mente : 

e Users  will  require  higher  quality  service  with  reduced  response  time 

• Users  will  p.iy  '*a  little  bit"  more  for  information  services,  but 
only  If  thc^  are  Improved  and  targeted  toward  their  precise  needs 

• For  DDC,  increased  demand  Is  seen  for  the  Defense  RDT&E  On-Line 
System  (DROLS) , Current  Awareness  Bibliographies,  and  RDT&E 
management  information  services 

Predicted  Problem: 

m Problems  in  obtaining  and  applying  Information  during  the  1978-1988 
period  are  predicted  to  be  of  the  same  kind  as  are  currently  being 
experienced,  but  these  problems  are  predicted  to  Increase  in 
intensity. 

.2  SUMMARY  OF  CONCLUSIONS 


Conaluaione  Directed  Toward  Provieion  of  Improved  DDC  Products  and 
Servicea: 


e The  current  and  predicted  needs  for  improved  quality  of  informa- 
tion services  point  up  the  roquizements  for: 


(a)  critically  analyzed  outputs  (Information  analysis) 

(b)  access  to  files  of  verified,  factual  data 

In  summary,  DDC  should  move  from  a position  of  providing  only 
bibliographic,  document-oriented  service  to  the  provision 
of  fact  and  infonratlon  service  as  well. 

• Continued  reliance  upon  personal  files,  projected  Increased 
demand  for  Current  Awareness  service,  and  preference  for  technical 
reports  and  Journals  in  hard  copy  require  greater  emphasis  upon 
the  human  (l.e.,  behavioral,  attltudlnal)  rather  than  the 
technological  aspects  of  Improved  Information  service. 

• The  fact  that  those  with  Top  Secret  clearances  saw  DDC  as  coming 
closer  to  meeting  their  needs  than  those  with  Secret  clearances 
highlights  the  Importance  of  DDC  as  a source  of  classified  Infor- 
mation and  Justifies  the  continuation  of  Its  providing  this  infor- 
mation. 

• The  need  for  a thorough  review  and  modification  of  the  DDC  RDT&E 
management  Information  system  Is  Indicated  by  the  findings  that: 

(a)  management  non-DDC  users  reported  more  satisfaction  In  the 
Information  service  they  received  elsewhere  than  DDC  manage- 
ment users 

(b)  management  respondents  reported  more  problems  In  accessing 
and  using  Information  than  bench  level  respondents 

(c)  support  personnel  ranked  management  user  satisfaction 
higher  than  did  these  users  themselves 

• Almost  half  of  the  survey  respondents  utilize  subscription  service, 
but  there  Is  no  Indication  that  this  will  ever  replace  retrospective, 
demand  search  service,  so  DDC  must  continue  to  provide  both  modes 

of  service.  However,  the  volume  of  demand  service  for  documents 
may  decrease  If. DDC  provides  fact  service  and  more  ADD  service. 

• Demand  for  DROLS  service  may  Increase  even  beyond  the  high  levels 
predicted  In  this  report  If  DDC  converts  from  leased  line  to  dial- 
up mode.  This  will  result  in  a significant  burden  upon  DDC  hardware. 

• Two  findings  Indicate  that  the  abstract  bulletin,  TAB,  could  be 
phased  out  during  the  target  period  because  In  the  future,  demand 
for  Current  Awareness  and  DROLS  services  will  Increase.  If 
these  demands  are  met,  the  usefulness  of  TAB  will  diminish. 
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Improved  access  to  Information  Analysis  Centers  (lAC's)  by  bench 
level  personnel  Is  required*  as  indicated  by  the  fact  that  support 
personnel  are  the  chief  lAC  users,  presumably  to  provide  informa- 
tion to  bench-level  users  in  their  organizations. 


Conoluaiona  Divaoted  Toward 
Tranafer  Ppooaaa: 


7XWad  Manaaement  of  the  RDTiE  Information 


The  problems  and  requirements  reported  in  information  currency 
and  response  time  Indicate  chat  Improved  management  of  all 
aspects  of  both  the  S&TI  and  the  RDT&E  management  information 
system  is  required,  from  Information  generation  to  end  use. 

The  fact  that  the  local  library  is  the  overwhelming  first  choice 
of  a source  for  Information  and  that  a "distant"  library  such  as 
DDC  is  one  of  the  last  choices  indicates  that: 

(a)  DDC  should  concentrate  its  efforts  on  serving  end  users 
through  local  librarians. 

(b)  increased  decentralization  and  regionalization  of  DDC  reference 
services  is  required 

(c)  remote,  on-site  access  devices,  such  as  DROLS,  will  be  welcomed 

The  need  for  development  and  application  of  a value  system  for 
information  services  is  highlighted  by  the  fact  that  most  users 
are  unaware  of  the  cost  of  Information. 

The  fact  that  users  appear  willing  to  pay  for  improved  quality 
and  reduced  response  time  opens  the  way  to  developing  an  Increased 
measure  of  accountability  in  the  DoD  RDT&E  information  transfer  process 

More  behavioral  research  is  required  in  developing  Improved  in- 
formation system  outputs,  since  77Z  of  respondents  reported  some 
disadvantages  in  using  even  their  preferred  iaformatlon  formats. 

DDC  must  be  even  more  concerned  than  other  information  transfer 
organizations  (such  as  NTIS)  with  the  rapid  delivery  of  current 
information,  especially  if  it  is  classified.  This  conclusion  is 
based  upon  the  finding  that  users  with  Top  Secret  classifications 
found  the  currency  of  the  information  they  received  less  satisfac- 
tory than  did  those  with  Secret  or  lower  level  classifications. 

DDC  is  one  of  the  few  S&TI  and  RDT&E  management  information  ser- 
vices that  provide  classified  information. 


Conoluaiona  Diraotad  Toward  Improved  Marketinf, 
Servioaa: 


DDC  Produota  and 


The  extremely  low  level  of  awareness  of  most  DDC  services  (l.e., 
only  4 out  of  22  DDC  services  are  known  to  more  than  IVX  of  the 
respondents  who  are  DDC  users)  among  all  classes  of  users  indicates 
a need  for  Improved  user  education  programs  targeted  specifically 
toward  demonstrating  how  DDC  services  can  satisfy  requirements 
of  each  class.  Users  indicated  by  a margin  of  75%  thet  they  would 
welcome  such  educational  progra  is. 


I 
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• The  Importance  of  marketing  of  DDC  services  Is  emphasized  by 
the  fact  that  DDC  Digest,  a user  education  tool,  was  ranked  as 
second  most  useful  DDC  subscription  service. 

• The  DDC  user  population  consists  of  a variety  of  strata , and  each 
must  be  considered  Independently  In  the  development  of  new  pro- 
ducts, services,  processing  modifications  and  marketing  programs, 
etc.  This  fact  Is  attested  to  by  the  low  correlations  between 
user  types  and  responses  to  questions.  Particular  attention 
should  be  directed  toward  the  delineation  of  Information  require- 
ments of  users  by  job  type. 

• DDC  should  continue  to  direct  a significant  portion  of  the  mar- 
keting of  its  services  toward  DoD  Contractors  (l.e.,  continuation 
of  the  "contractor  access  program") , since  more  contractors  than 
DoD  respondents  reported  problems  with  the  amount  of  information 
they  had  been  receiving i also  becau.:.;  fewer  contractors  than  DoD 
personnel  were  aware  of  DDC  services. 

• The  discrepancies  between  user  satisfaction  and  support  personnel 
perception  of  the  degree  of  user  satisfaction  militates  for  the 
establishment  of  a user  feedback  system  which  will  provide  direct 
feedback  from  users  without  the  intervention  of  support  personnel, 
who  would  tend  to  act  as  filters. 

1.3  SUMMARY  OF  METHODOLOGY 


1 


In  order  to  gather  the  information  necessary  for  this  forecasting  study, 

AUERBACH  used  a combination  of  telephone  interviewing  and  mailed  questionnaires. 

The  methodology  consisted  of  three  steps: 

(a)  Drawing  the  saiupl? 

(b)  Development  of  the  interview  schedule  and  conduct  of  the 

interviews  j 

I 

(c)  Data  analyses  and  interpretation  of  results  | 

A more  complete  description  of  the  methodology  is  contained  in  Appendix  A. 


1.3.1  Drawing  of  Sample 

A total  of  2,886  user  organizations  with  an  estimated  population  of 
150,000  users  were  surveyed.  This  population  was  stratified  as  follows: 

• Type  of  Organization/Organizational  Use  of  DDC 

DoD  Organizations  - Key  Users 
- DoD  Organizations  - Non-Key  Users 

Contractor  Organizations  - Key  Users 
Contractor  Organizations  - Non-Key  Users 
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• Type  of  Job 

- Bench  level  personnel 

*-  Management  personnel 

- Support  personnel  (librarians,  information  specialists,  etc.) 

• Individual  Use/Non  Use  of  DDC 

- Individual  users  of  DDC 

- Individuals  who  do  not  use  DDC 

A random  sample  of  twenty-five  organizations  was  selected  from  each  of 
the  four  types  of  organizations.  Twenty  staff  members  were  then  selected  randomly 
from  each  organization.  These  twenty  were  selected  to  include  all  three  types 
of  jobs,  and  both  users  and  non-users. 

1.3.2  Development  of  the  Interview  Schedule  and  Conduct  of  the  Interviews 

Survey  respondents  were  initially  contacted  by  phone,  scheduled  for  an 
interview  and  then  sent  a packet,  including  a set  of  cards  that  provided  the 
response  alternatives  for  a majority  of  the  questions  in  the  Interview. 

Two  highly  structured  Interview  schedules  were  developed:  one  addressed 

toward  managers  and  bench  personnel,  and  the  other  addressed  to  support  personnel. 
Interviewers  training  sessions  were  conducted,  and  4%  of  all  interviews  were 
monitored  to  ensure  quality  control  and  reliability.  A total  of  698  interviews 
were  successfully  completed  (See  Section  II  And  Appendix  B for  a categorization 
of  the  interviewed  population) . 

1.3.3  Data  Analysis 

The  analysis  of  the  data  for  this  project  proceeded  in  three  phases: 

• Identification  of  major  Independent  variables  of  Interest 
(e.g.,  DDC  user  vs.  non-user)  via  multiple  regression  analysis 

• D ‘termination  of  significant  effects  of  Independent  variables 
on  dependent  variables  (e.g.,  favorite  media)  via  variance 
and  contingency  analysis 

• Identification  and  prediction  of  future  trends  in  the  S&TI/RDT^'.K 
management  information  environment. 
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SECTIOM  II;  CATEGORIZATION  OF  USERS/POTENTIAL  USERS 

This  study  focuses  upon  the  population  of  users  and  po*-enf  :1  users 
of  S&TI  and  RDT&E  management  Information  In  the  DoD  community.  Tf  /efore,  the 
sample  vas  designed  to  represent  the  major  characteristics  of  th'.  members  of  this 
population.  These  are: 

• Type  of  Organization 

DoD  organizations 

DoD  contractor  organizations 

• Organizational  Use  of  DDC 

- Key  user  (heavy  user)  organizations 

- Non-key  user  organizations 

• l^ype  of  Job 

- Bench  level  personnel 

- Management  personnel 

- Support  personnel 

• Individual  Use/Non-Use  of  DDC 

- Individual  users  of  DDC 

- Individual  non-users  of  DDC 


I 
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All  of  the  characteristics  listed  above  produced  significant  differences 
between  groups.  However,  different  job  tyrtes  clearly  produced  In  the  most  meanlng- 
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ful  distinctions  among  users  and  potential  users.  Therefore,  it  is  the  principal 
means  by  which  users  and  potential  users  can  and  should  be  categorized  for 
planning  purposes.  See  Appendix  B for  a complete  detailed  breakdown  of  the  sample 
population. 

Additional  variables  not  serving  as  strata  In  the  sample,  but  analyzed 
f'>r  their  Influence  upon  user  attitudes  and  behavior  are: 

(a)  Highest  degree  obtained 

(b)  Security  classification 

Years  of  experience  In  research  and  development 

(d)  Hours  per  week  engaged  In  research 

(e)  COSATI  Fields 

The  characteristics  of  respondents  In  terms  of  these  variables  are  also 
contained  In  Appendix  B. 
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SECTION  III.  THE  CURRENT  S&TI  AND  RDT&E  MANAGEMENT 
INFORMATION  ENVIRONMENT 


The  interview  schedule  used  in  this  survey  was  designed  to  elicit 
Infomation  requirements  and  problems  by  identifying  critical  incidents  in 
respondents'  search  strategies.  First  respondents  were  questioned  regarding 
the  physical  location  that  they  first  go  to  when  searching  for  information 
(l.e.,  the  source) , and  then  the  questions  were  shifted  to  formats  (e.g.,  journal 
articles,  technical  reports,  etc.)  in  which  they  receive  information  most  useful 
to  them,  and  then  to  the  physical  means  of  the  presentation,  or  media  of  informa- 
tion. Respondents  who  were  identified  as  DDC  users  were  then  asked  a series  of 
questions  regarding  their  requirements  for  and  problems  with  DDC  products  and 
services. 


3.1  CURRENT  REQUIREMENTS 

3.1.1  Primary  Sources  of  Information 


e 50. 7Z  (N>306)  of  the  respondents  choose  their  in-house  library  as 
their  primary  formal . source  of  information 


A distant  second  and  third,  in  the  order  of  preference 
are  respectively  departmental  collections  (80  or  13.2%)  and 
users'  personal  collections  (79  or  13.1%).  Friend,  peer  or 
associate  is  the  only  other  source  receiving  frequent  mention 
(43  or  7.1%) 
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• Only  2.3%  (14)  of  respondents  Indicate  a preference  for  a "distant" 
library  as  a first  choice  Information  source 

• 90.3%  of  the  respondents  report  that  they  typically  find  their 
most  useful  information  at  their  first  source 

• The  more  years  of  experience  In  R&D  activities,  the  lower  the 
percentage  of  Information  that  a researcher  finds  at  his  first 
step  In  the  search  process.  At  subsequent  steps  In  the  search 
process : 

(1)  there  Is  a positive  correlation  (.13)  between  hours/week 
doing  bench  research  and  success  In  finding  useful  information 

(2)  management  personnel  find  a higher  percentage  of  Information 
(29.1%)  than  bench  level  workers  (24.1%). 


See  Appendix  C,  Table  C-1  for  a tabular  presentation  of  findings  lii  the 
area  of  primary  sources  of  Information. 


3.1.2  Informal  Sources  of  Information 


A serl''3  of  questions  was  specifically  directed  toward  respondents' 
use  of  Informal  sources  of  Information,  Including  use  of  personal  and  departmental 
collections. 

• Researchers  with  more  R&D  experience  (16.6  years  vs.  13.8)  and  those 
with  Ph.D.'s  (25,  21%  vs.  53,  10%)  rely  more  heavily  or.  their  own 
personal  collections  than  those  with  less  experience  and  those  with- 
out Ph.D. 's. 

• Three  categories  of  respondents  agreed  with  greater  frequency  than 

their  counterparts  that  they  could  use  assistance  In  organizing  their 
personal  collections:  49.5%  of  those  with  doctorates  (55)  versus 

32.7%  of  those  without  doctorates  (153),  41.6%  of  those  In  contrac- 
tor organizations  (114)  vs.  30.3%  (99)  In  DoD  agencies  and  38.5% 

(184)  of  the  DDC  users  versus  27.4%  (35)  of  non-users. 

• Users  with  bachelors  degrees  (35  or  12.8%)  rely  more  heavily  on 
department  collections  than  those  with  Ph.D.'s  (7  or  5.9%). 

3.1.3  Formats 


s Technical  reports  and  Journals  are  by  far  the  most  useful  formats, 
preferred  as  "most  useful"  by  34.8%  (N"243)  and  16.3%  (N«114)  of 
the  respondents,  respectively. 

s Other  formats  receiving  mention  Include  handbooks  and  manuals  (N*62) 
abstract  Journals  (N*61)  and  computer  generated  bibliographies  (N*58) , 
each  preferred  by  approximately  8%  of  the  respondents. 


• The  formats  reported  by  the  users  to  be  the  second  most  useful 
In  their  Information  searches  follow  an  almost  identical  pattern 
except  that  technical  reports  receive  less  mention. 

e 520  (77Z)  of  the  respondents  report  some  disadvantages  In  utilizing 
their  preferred  formats  and  almost  as  many,  478  (71.2%),  report 
some  disadvantages  In  utilizing  their  second  most  preferred  format. 
In  general,  more  users  with  a Ph.D.  (100  or  87.7%)  and  more  of  those 
working  In  contractor  organizations  (250  or  83.1%)  report  disad- 
vantages with  the  formats  they  find  to  I- e most  useful  than  do 
those  without  the  Ph.D.  (394  or  76.8%)  and  those  In  DoD  cgancles 
(266  or  72.3%)  respectively. 

Frequencies  for  each  format  may  be  found  In  Appendix  C,  Table  C-2. 


3.1.4  Media 


• The  vast  majority  of  respondents  (588  or  84.2%)  Indicated  that  they 
rely  most  heavily  on  printed  (hard  copy)  documents.  This  over- 
whelming and  continued  reliance  on  printed  documents  Is  significant, 
considering  the  technological  Innovations  In  the  Information  science 
field  during  the  past  several  years. 

• Verbal  communication  comes  In  es  the  second  most  preferred,  with 
51  (7.3%)  respondents  Indicating  that  It  serves  as  their  primary 
medium. 

• Microfiche  and  computer  printouts  are  mentioned  by  20  (2.9%)  and 
19  (2.7%)  respondents. 

Preference  for  various  media  are  listed  in  Table  C-3  In  Appendix  C. 

3.1.5  User  Charges 

A munber  of  questions  were  asked  regarding  users'  attitudes  toward  the 
costs  of  the  services  thct  they  utilize. 


i 
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s Users  are  unaware  of  the  cost  of  Information.  (In  many  cases, 
the  overwhelming  majority  of  user  organizations  attach  no  con- 
tingencies to  the  amount  of  money  users  spend  on  Information 
services.  Therefore,  survey  respondents'  reports  regarding  cost 
data  need  careful  scrutiny.) 

s The  vast  majority  of  those  responding  (478  or  80.3%)  say  that  they 
would  prefer  a service  they  pay  for  that  covers  precise  needs  In 
specialty  areas  to  a free  service  covering  broad  areas.  This  majority 
consists  of  significantly  more  respondents  working  In  non-key 
organizations,  (202  or  84.2%)  than  those  working  In  key  organizations 
(269  or  77.3%). 
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• Respondents  were  asked  If  they  currently  subscribe  to  any  ser- 
vices which  automatically  provide  Information  according  to  pre- 
viously registered  categories.  Three  hundred  twenty-seven,  or 
46. 8Z  of  those  responding  Indicate  that  they  do  subscribe  to  such 
a service.  Of  these,  IS.S  (56. 6Z)  tsay  that  they  pay  for  the 
service. 

• A series  of  questions  was  asked  In  order  to  determine  users' 
willingness  to  "trade  off"  between  Improvements  in  the  aspect 

of  service  that  they  rate  the  lowest, and  Increases  In  cost.  Three 
hundred  fifty-nine  (73.12)  respondents  reported  that  they  would  be 
willing  to  pay  more  to  Improve  Information  services,  while  only  132 
(.'^6.92)  say  that  they  would  not  be  willing  to  pay  more.  Of  those 
who  responded  to  questioning  about  how  much  more  they  would  be  will- 
ing to  pay,  31.82  (70)  say  that  they  would  be  willing  to  pay  "a 
lot  more",  24.92  (106)  Indicate  that  they  would  be  willing  to  pay 
"somewhat  more"  and  43.32  (161)  say  that  they  would  be  willing  to 
pay  "Just  a little  bit"  more. 

• Respondents  were  then  asked  If  they  would  be  willing  to  wait  longer 

In  order  to  Improve  the  services  that  they  receive:  58.32  (222) 

said  no  and  41.72  (159)  srld  yes.  The  predominant  attitude  among 
those  who  do  say  that  they  would  be  willing  to  wait  longer  Is  that 
they  would  only  be  willing  to  wait  "a  little  bit"  longer  to  Improve 
the  services  they  receive. 

In  summary,  survey  respondents  are  not  enthusiastic  about  either  an 
increase  In  cost  or  an  Increase  In  response  time.  However,  It  does  seem  clear 
that  they  would  be  more  willing  to  acc;:'pt  Increases  In  cost  than  an  Increase  In 
response  time. 

3.1.6  DDC  Products  and  Services 


Respondents  who  Indicated  that  they  were  users  of  DDC  were  asked  to 
compare  DDC  services  with  a comparable  service  nrovlded  by  another  agency  that 
the  Interviewee  said  that  he  used.  In  terms  of  six  dimensions: 

Quantity  of  Information  provided 

Quality  of  Information  provided 

Time  lag.  In  terms  of  response  time 

Currency  of  information  provided  ("up-to-dateness") 

Medium  In  which  the  Information  Ir  provided 
Format  In  which  the  Information  Is  provided 

Survey  participants  responded  on  a 5-point  scale  from  "Always  met  my 
needs"  (a  score  of  1)  to  "Never  met  my  needs"  (a  score  of  5)  for  each  of  the  six 
dimensions . 


• Tfiere  are  no  significant  differences  between  DDC  and  other 
agencies  on  any  of  the  six  dimensions.  Users  perceive  the 
services  provided  by  the  DDC  and  comparable  agencies  as 
approximately  equivalent  in  meeting  their  needs  In  these 
respects. 

a There  were  significant  differences  between  those  with  Top- 
Secret  classifications  and  those  with  Secret  classifications 
on  the  quality  and  the  currency  dimensions.  In  both  cases, 
those  with  Top-Secret  clearances  see  the  DDC  services  as  .3 
points  closer  to  meeting  their  needs  than  do  those  with  Secret 
clearances . 


3. 1.6.1  Awareness  of  DDC  Services 


A series  of  questions  was  asked  to  determine  the  awareness  of  DDC  users 
regarding  specific  DDC  services.  These  questions  were  not  directed  to  DDC  non- 
users who  were  assumed  to  be  unaware  of  any  DDC  services.  Detailed  results  appear 
In  Appendix  C,  Tables  C-4  and  C-5. 

a The  best  known  DDC  demand  service  is  the  Technical  Report  Program, 
(known  to  29C,  or  86.3%,  of  respondents)  which  Is  followed  closely 
in  awareness  by  Report  Bibliographies  (75.6%).  The  other  demand 
services  fall  further  down  the  list  and  are  not  nearly  so  well 
known  as  these  two. 

• Among  the  subscription  services,  TAB  Is  by  far  the  best  known 

with  283  (84.2%)  respondents  reporting  awareness.  TAB  Is  followed 
by  the  DDC  Digest,  with  174  (51.8%)  users  Indicating  awareness, 
and  then  by  ADD  and  Current  Awareness  Bibliographies. 

a Questions  about  specific  DDC  services  produced  hesitancy  and  an 
apparent  lack  of  knowledge  of  these  services  on  the  part  of  many 
DDC  users.  Of  the  544  DDC  users  in  the  survey,  only  336  (61.8%) 
were  able  to  give  meaningful  responses  to  the  question  on  aware.>ess 
of  specific  DDC  services.  Many  of  the  208  users  (38.2%)  who  were 
not  able  to  answer  these  questions  know  that  they  use  DDC,  but  are 
not  sure  which  of  the  Information  products  and  services  that  come 
to  their  attention  are  from  DDC  and  which  are  from  another  agency. 

a Users  in  DoD  agencies  are  significantly  more  aware  of  DDC  services 
than  are  users  In  DoD  contractor  organizations. 

a Support  personnel  are  often  not  aware  of  many  of  the  DDC  services. 
The  percentage  of  support  personnel  who  are  aware  of  DDC  services 
range  from  as  low  as  38.6%  (for  Current  Awareness)  to  88.6%  (for 
TAB) . 

3. 1.6. 2 Preference  Among  DDC  Services 

Respondents  were  asked  to  rank  the  DDC  subscription  and  demand  services 
separately  in  terms  of  those  that  they  found  to  be  most  useful.  Detailed  results 
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appear  In  Appendix  C,  Tables  C-4  and  C-5.  Usage  by  Job  type  is  shown  in  Tables 
C-6  and  C-7. 

• The  Technical  Report  Program  Is  by  far  the  most  popular  of  demand 
services  with  207  (63.1%)  respondents  rating  It  most  useful. 

• Report  Bibliography  Service  Is  a distant  second  In  popularity, 
with  only  59  (18%)  respondents  choosing  It  as  the  most  useful 
service. 

• In  a choice  of  second  most  useful,  Report  Bibliographies  rank 
first  (107  respondents,  40.7%)  and  the  R&T  Work  Unit  Information 
system  rank  second  (43  respondents,  16.3%) 

• Among  the  DDC  subscription  services,  TAB  receives  by  far  the 
most  votes  for  first  choice,  with  190  (71.4%)  participants 
choosing  It.  ADD  tecelved  26  votes  (9.8%)  as  first  choice. 

a The  DDC  Digest  Is  the  second  choice  as  most  useful  subscription 
service,  with  56  (32.7%)  respondents. 

• Lack  of  awareness  was  again  revealed  when  respondents  were  asked 
to  rank  specific  DDC  services  In  terms  of  those  that  are  most  and 
least  useful  to  them.  Only  263  of  336  (78.3%)  chose  a second  most 
useful  demand  service,  152  (45.2%)  chose  a least  useful  service 
and  105  (31.3%)  chose  a next  to  the  least  useful  demand  service. 
The  pattern  was  similar  for  subscription  services. 


3.1.6. 3 RDT&E  Management  Information  System 


A series  of  questions  was  designed  to  measure  various  aspects  of  users' 
perceptions  of  the  RDT&E  Management  Information  System  (MIS)  — WUIS,  IR&D  and 
Program  Planning  Reports.  The  differences  between  the  WUIS  and  the  IR&D  data  base 
must  be  Interpreted  differently,  because  contractors  do  not  have  access  to  IR&D. 

• 124  (22.8%)  of  the  DDC  users  Interviewed  report  using  the  R&T 
Work  Unit  Information  System 

• 51  (9.4%)  report  having  used  Program  Planning  Reports. 

• 42  report  that  they  used  the  IR&D  data  base.  (This  amounts  to 
7.7%  of  all  DDC  users,  but  11.3%  of  the  DoD/DDC  users.  Only 
DoD  personnel  are  permitted  access  to  the  IR&D) . 

m In  general,  attitudes  toward  the  six  dimensions  of  the  services 
provided  by  these  MIS  data  bases  are  on  the  favorable  side. 


3-6 


• WUIS  is  used  by  a larger  percentage  of  DoD  researchers  (93  or  30. 9Z) 
than  contractors  (31  or  12. 8Z).  A majority  of  support  personnel 
(52  or  59. IZ)  use  WUIS.  The  same  patterns  of  use  by  job  type  may  be 
observed  for  Program  Planning  Reports  and  the  IR&D  data  bases,  with 
support  personnel  utilizing  them  more  heavily  than  management  and 
bench  level  users. 

Table  C-8  in  Appendix  C shows  these  findings  In  tabular  form. 


3.1.7  Information  Analysis  Centers 

Detailed  information  regarding  the  use  of  various  Information  Analysis 
Centers  is  presented  in  Table  C-9.  Here,  it  may  be  seen  that  few  bench  and 
management  personnel  use  these  centers.  While  the  percentages  for  the  support  per- 
sonnel are  much  larger  than  for  the  bench  and  management  users,  even  these  are 
quite  low. 

3.1.8  User  Training  and  Marketing 


Respondents  were  asked  if  they  felt  that  training  programs  on  DDC  services 
would  be  of  help  to  them. 

• 75. (N*279)  say  that  they  thought  it  would  help;  24,6%  (N*91) 
say  no 

• Of  those  who  expressed  Interest  in  such  training,  91.8%  (N>256) 
say  that  they  would  make  use  of  it,  if  it  were  available.  Many 
spontaneously  added  the  provision  that  training  programs 
"...shoold  not  take  too  much  time.” 


3.2  CURRENT  PROBLEMS  CN  INFORMATION  USE 


r 


In  order  to  identify  current  problems  regarding  various  aspects  of  in- 
formation services,  users  were  asked  to  describe  their. information  search  experi- 
ences along  the  six  dimensions  previously  described  for  evaluation  of  DDC  services. 
Since  th«s  correlations  among  the  six  dimensions  were  very  low,  it  was  assumed  that 
the  six  dimensions  were  measurlig  distinctly  different  aspects  of  Information  search 
services.  ,\s  a result,  the  responses  to  these  dimensions  were  anlayzed  separately. 

• On  the  whole,  respondents  felt  at  least  "mildly  satisfied"  with  all 
aspects  of  information  services  which  they  currently  recelvf;,  since 
the  average  scores  on  all  six  dimensions  were  on  the  posi.i/e  side 
of  the  neutral  point. 

• In  general,  respondents  report  fewer  problems  in  terms  of  the  media  . 
and  formats  in  which  information  appears.  Average  scores  on  the  five 
point  scale  (.from  "never  met  my  needs,"  represented  by  a score 
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of  5,  to  "always  met  my  needs,"  represented  by  a score  of  1) 
form  a cluster  at  the  low  end  of  the  scale  and  are  shown  below 
In  parenthesis : 

Minor  Problem  Areas 

Format  (2.06) 

Media  (1.98) 

A second  cluster,  Indicating  a higher  degree  of  problems  experi- 
enced, Is  formed  by  the  other  four  dimensions:  Information 

quantity  (amount),  quality,  response  time  (time  lag)  and  currency. 
Average  scores  on  the  five  point  scale  are: 

Major  Problem  Areas 


Quality  (2.35) 
Response  Time  (2.31) 
Quantity  (2.26) 
Currency  (2.20) 


DoD  agency  personnel  report  that  the  amount  of  Information  they 
receive  comes  closer  to  meeting  their  needs  than  do  the  DoD  Con- 
tors  C2.ll  vs.  2.36). 

Managemeut  personnel  report  that  the  quality  of  Information  Is 
further  from  meeting  their  needs  than  do  bench  level  users 
(2.48  vs.  2.24). 

Management  personnel  report  less  satisfaction  than  the  support 
personnel  thought  they  were  experiencing.  This  discrepancy 
between  management  and  support  personnel  Indicates  that  support 
personnel  see  management  as  experiencing  significantly  more 
satl.^factlon  than  they  actually  do  on  this  dimension.  In  addition, 
DDC  userc  among  management  personnel  report  less  satisfaction 
t’.an  managers  who  do  not  use  DDC  services  (2.57  vs.  2.16). 

In  terms  of  the  up-to-datenesa  of  the  Information  they  receive, 
those  with  Top-Secret  classifications  report  less  satisfaction 
with  this  aspect  of  service  than  their  counterparts  with  Secret 
classifications  (2  44  vs.  2.14).  It  appears  that  there  Is  a 
strong  relat jnr.jh jp  between  Top-Secret  classifications  .Jnd  the 
Individual  reseArcher's  need  for  up-to-date  Information. 

Support  personnel  perceive  the  managers  and  bench  level  users 
as  more  satisfied  with  the  currency  of  Information  than  they 
actually  are.  However,  this  discrepancy  appears  only  among 
those  with  Top-Secret  classlflcatlo:.s  (2.52  vs.  2.08). 

Bench  level  users  report  somewhat  more  satisfaction  with  the  format 
In  which  they  receive  their  information  than  do  management  level 

users  (1.98  vs.  2.12). 


SECTION  IV.  PREDICTED  S&TI  AND  RDT&E 
MANAGEMENT  INFORMATION  ENVIRONMENT 


The  series  of  questions  regarding  the  six  dimensions  of  Information 
services  that  were  asked  for  1975  was  also  asked  retrospectively  for  1970  and  for 
the  respondents'  expectations  for  1980.  Tre*  across  these  three  time  periods 
were  computed  for  each  of  the  six  dimensions. 

4.1  PREnrOTED  REQUIREMENTS 


4.1.1  General 


e Approximately  25Z  of  the  users  feel  that  Improvements  In  quality 
and  response  time  would  be  most  useful  to  them.  17.9%  feel  that 
Improvements  In  currency  would  be  most  useful,  while  11.2%  are 
most  Interested  In  Increasing  the  amount  of  Information.  Finally, 
about  9%  see  change  In  media  and  format 'as  most  useful. 

a Management  personnel  are  more  often  Interested  than  are  support 
personnel  In  Improving  quality,  whereas  support  personnel  are 
more  Interested  In  changing  the  media  than  are  bench  researchers 
or  managers.  Bench  level  researchers  more  often  feel  that  Improve- 
ment In  currency  would  be  most  useful  to  them.  See  Table  D-1, 
Appendix  D for  details. 

• In  order  to  effect  the  Improvements  they  would  like  to  see  by  1980, 
526  (87.7%)  respondents  say  that  they'd  be  willing  to  pay  more, 
while  74  (12.3%)  say  they  would  not  be  willing  to  do  so.  37%  would 
be  willing  to  wait  longer  to  receive  Information,  but  63%  would  not 
be  willing. 

• 50%  of  the  respondents  say  that  they  would  be  willing  to  pay  for 

a service  that  Is  matched  precisely  to  their  needs.  Of  this  group, 
the  percentage  of  DoD  Contractors  was  higher  than  that  of  DoD 
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researchers  (98  or  40.3%  vs.  55  or  18.3%). 


4.1.2  Remote  On-Line  Retrieval  Services 


• 59.2%  (322)  DDC  users  are  currently  unfamiliar  with  remote  on-line 

services  even  though  remote  on-line  retrieval  systems  appear  to 
be  the  "wave  of  the  future".  40.8%  (222)  of  the  DDC  users  report 
they  had  heard  about  the  possibility  of  on-line  Information  ser- 
vices, but  only  114  (20.9%)  say  they  have  used  such  a system. 


• There  Is  a striking  lack  of  familiarity  with  the  DDC  RDT&E  on- 
line system  (DROLS)  except  among  the  support  personnel  (75%  vs. 
18.4%). 

• DoD  researchers  (98  or  32.6%)  are  more  familiar  than  contractors 
(50  or  20.6%)  with  DROLS.  (This  Is  probably  because  more  DoD  per- 
sonnel are  provided  with  access  to  DROLS  than  are  contractors.) 

4.1.3  Future  Demand  for  DDC  Services 

Past  records  of  DDC  activity  were  analyzed  In  order  to  estimate 
potential  future  demand  upon  DDC  for  various  categories  of  service.  System 
records  were  analyzed  separately  at  yearly  intervals  for  each  category  of  service. 
Records  were  utilized  as  far  back  as  the  criteria  for  recording  of  Input  and  output 
volume  of  a particular  DDC  service  remained  unchanged. 
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• Technical  Reports  \ 

i 

i 

I 

System  records  for  Technical  Report  output  were  analyzed  from 
FY  1972  to  FY  1973.  Data  prior  to  1972  were  excluded,  because 
DDC  Introduced  charges  for  services  in  FY  1972,  thereby  affecting 
user  behavior  and  making  comparisons  between  pre-and  post- 1972 
system  records  misleading.  Inspection  of  these  system  records 
reveals  that  output  for  Demand  Technical.  Reports  is  lower  In 
recent  years  relative  to  Automatic  Document  Distribution  (ADD). 

Changes  In  both  hard  copy  and  microfiche  Demand  Technical  Reports 
have  been  erratic,  suggesting  a slight  absolute  decrease  relative  | 

to  ADD;  that  Is,  the  proportion  of  Technical  Reports  delivered  i 

on  demand  has  been  decreasing.  Because  of  the  erratic  pattern  1 

here,  no  predictions  were  made  for  Demand  Technical  Reports.  | 

In  .972,  DDC  delivered  168,855  technical  reports  as  part  of  the  I 

ADD  Frograro.  In  1973,  the  total  was  207,274;  In  1974  343,882  | 

and  In  1975  382,358.  The  method  of  least  squares  was  applied  I 

' to  the  data  points  to  determine  the  "best  fitting"  curve  or  I 

straight  line.  Then  output  for  future  years  was  estimated  on  1 

the  basis  of  extrapolation  from  this  best  fitting  line.  It  should  i 

be  noted  here  that  the  accuracy  of  forecasting  based  on  this  m 

approach  Is  limited  by  the  assumptions  that  are  made.  For  example,  ■ 


It  ts  assumed  that  no  additional  vtirlables  will  be  ■•ntroduced  In 
the  future.  If  assumes  oo  other  extraneous  ^ ables  (such 
as  In  DoD  RDT&E  programming  or  budgeting),  then  a -asonably 
accurate  prediction  ran  he  pade.  T’slng  this  appro  -n,  the  best 
prediction  for  the  1988  levfl  of  demand  for  ADD  Technical  Reports 
Is  882,346.  This  prediction  Is  based  on  FY  1974  and  FY  1975, 
becuase  Inclu/ilng  1972  and  19/3  would  have  produced  unreasonably 
high  predlctlcns.  In  other  words.  It  Is  believed  that  the  sudden 
Increases  for  1972  to  1973  and  from  1973  to  1974  are  not 
representative  for  future  annual  changes.  The  sharp  Increases 
during  these  years  may  be  partly  a result  of  user  readjustment 
after  t'  e policy  and  price  changes  In  1972.  Predictions  for 
each  Intervening  year  between  1976  and  1988  for  changes  In  ADD 
output  may  be  found  In  Appendix  D,  Table  D-2  and  Figure  D-7. 

• Current  Awareness  Bibliographies 

Starting  with  2,399  Current  Awareness  Bibliographies  in  1970, 
the  demand  rose  to  14,683  in  1974.  Of  all  the  system  records, 
this  service  came  closest  to  departing  from  a straight  line. 
Several  curved  line  functions,  such  as  parabolic  and  exponential, 
were  fit  to  the  data,  but  all  yielded  unrealistically  high  pre- 
dictions. It  Is  recognized  that  this  service  Is  currently  not 
generally  available  to  all  DDC  users.  However,  If  limitations 
are  removed,  demand  could  well  exceed  predictions  based  on 
extrapolations  from  a straight  line  that  excludes  the  first  two 
years  of  system  record  keeping.  Therefore,  a "best  fitting"  line 
was  determined  for  1972  through  1974,  and  forecasting  was  based 
on  these  three  points.  Predictions  for  1976  are  23,933  and  for 
1988,  82,933.  See  Table  D-3  and  Table  D-9,  Appendix  D. 

• Defense  RDT&E  On-Line  System  (DROLS) 

It  Is  predicted  that  on-line  remote  services  will  reach  360,600 
searches  by  1988  (See  Appendix  D,  Table  D-4  and  Figure  D-9). 
However,  the  sudden  recent  Increase  in  usage  of  DROLS  from  1973 
to  1974  makes  predictions  less  accurate  and  stable  than  would  be 
the  case  were  data  available  over  a longer  period  of  time.  There 
A'ore,  predictions  for  DROLS  may  be  less  accurate  than  the  other 
predictions  advanced  In  this  report.  Sj^eclf Ically,  predictions 
for  DROLS  may  underestimate  future  levels  of  user  demand.  In 
spite  of  this,  DROLS  Is  predicted  to  be  among  the  DDC  services 
with  heaviest  demand. 

• Management  Information  Services 

System  records  for  usage  of  the  management  Information  data  bases 
are  extensive  and  provide  five  separate,  but  related  forecasts 
of  future  demand.  Predictions  for  1988  are  as  follows: 


IR&D  - Output 

4,738 

Program  Planning 

Reports  - Output 

790 

Work  Units  - Input 

96,000 

Work  Units  - Output 

33,984 

Work  Units  - Changes 

272,040 
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These  predictions  show  that  future  levels  of  demand  for  management 
Information  services  will  rise  steadily.  Even  though  input 
to  the  Work  Unit  data  base  will  most  likely  remain  stable,  ser- 
vices that  are  derived  from  these  data  bases  will  Increase. See 
Tables  D-5  and  D-8  and  Figures  D-10  and  D-13  in  Appendix  D. 


In  summary,  significantly  increased  demand  is  predicted  for  three  cate- 
gories of  currently-provided  DDC  services: 

• Current  Awareness  Bibliographies 

• DROLS 

• RDT&E  management  inforn  :lon  services 

These  predictions  are  particularly  interesting,  since  (a)  Current  Awareness  Biblio- 
graphy service  is  not  well-advertised  by  DDC,  and  (b)  the  other  two  services  were 
introduced  relatively  recently. 

A. 2 PREDICTED  PROBLEMS 


Respondents  were  asked  about  their  experience  in  gathering  Information 
in  1970  and  1975,  and  about  their  expectations  for  1980  in  terms  of  the  six 
dimensions  (quantity,  quality,  response  time,  currency,  formats,  media). 

• A clearcut  pattern  emerged  showing  a significant  decrease 
in  problems  experienced  in  gathering  information  between 
1970  and  1975. 

• When  users  were  asked  to  predict  how  close  each  aspect  of  ser- 
vice would  come  to  meeting  their  needs  in  the  future,  there  vas 
a large  and  highly  significant  increase  in  problems  anticipated 
in  1980. 

• Using  the  method  of  least  squares,  extrapolations  were  made  beyond 
1980  to  1988.  For  each  of  the  six  dimensions,  the  result  is  a 
continued  increase  in  anticipated  problems  through  1988. 

• Formats  and  media  were  seen  as  the  dimensions  least  likely  to 

be  problems  in  1980  (similar  to  results  presented  in  Section  3.2 
above) . 

• Quantity,  quality,  response  time,  and  currency  were  seen  as  most 
likely  to  be  problems  in  1980.  (Similar  to  results  presented  in 
Section  3.2  above).  . 


Graphs  showing  these  projections  are  shown  in  Appendix  D,  Figures 
D-1  to  D-6. 


Since  no  changes  in  Work  Unit  input  are  predicted,  a graph  and  table  are  not 
present  in  Appendix  D. 


A-A 


GLOSSARY 


This  glossary  is  intended  to  facilitate  use  of  this  Survey  Results  Report 
by  providing  definitions  of  DDC  products  and  services,  statistical  terms, 
acronyms,  and  information  storage  and  retrieval  terminology.  Cross  references 
are  made  in  some  definitions  to  terms  which  are  related  to  defined  terms,  and  which 
are  also  defined  in  this  glossary.  (These  terms  are  underlined). 


Abstract  Journal 


A publication  appearing  at  regular  intervals,  containing  citations  and 
abstracts  of  selected  documents  in  a particular  subject  field  or  fields. 

(e.g.,  TAB) 

Accountability 

The  quality  or  state  of  being  answerable  (responsible)  for  decisions  made. 


ADD 


Automatic  Docutient  Distribution.  A service  which  supplies  microfiche 
copies  of  DDC  documents  in  specific  subject  areas  to  users  who  have  supplied 
a subject  interest  "profile." 

Average 

A quantity  arrived  at  by  adding  a series  of  quantities  together  in  any 
order,  and  dividing  by  their  number.  (Also  called  "arithmetic  mean.”  Com- 
pare : Modal  Score) . 

Awareness  (of  a service) 

Knowledge  that  a given  service  exists,  whether  or  not  the  respondent  has 
used  it. 

Bench  Level  (personnel) 

Personnel  performing  primarily  research,  development,  testing,  and  evalua- 
tion activities.  Also  sometimes  referred  to  as  researchers.  (Contrast: 
Management  personnel). 


Bibliographic  (service) 

A type  of  Information  service  which  provides  information  in  the  form  of 
documents,  (reports,  books,  etc.)  or  abstracts  of  documents,  or  document 
citations  (Contrast:  Fact  service) 


Cathode  Ray  Tube  (CRT) 


A possible  component  of  an  on-line  Information  system  consisting  of  a 
vacuum  tube  (similar  to  a TV  screen)  on  which  text  or  data  can  be  projected  by 
the  computer  for  direct  viewing  by  a person  doing  an  on-line  search  or  query. 

Comparable  Source 

An  information  service  supplied  by  a non-DDC  agency  which  is  similar  to 
a given  DDC  service  (e.g.,  the  NASA  technical  report  program  is  comparable  to 
DCC  Technical  Report  Program). 

Computer-Generated  Bibliography 

A computer-printed  list  of  docuir.ents  produced  as  the  output  of  a computer 
search  by  subject  area(s)  of  a machine- readable  file  of  document  citations. 

Consultant 

An  individual  or  organization  who  gives  pxofesslonal  advice  or  services 
in  response  to  a respondent's  information  needs. 

Contingency  Analysis 

A statistical  method  for  computing  the  probability  of  the  Joint  occurrence 
of  attributes. 

Contractor  Access  Program 

A DDC  program  to  test  the  feasibility  of  providing  Defense  contractors  with 
access  to  the  Defense  RDT&E  On-Line  System  (DROLS). 

COSATI 


Committee  On  Scientific  And  Technical  Information  of  the  Federal  Council 
for  Science  and  Technology.  A committee  which  had  responsibility  for  the 
coordination  of  Federal  agency  programs  on  information' for  science  and  tech- 
nology. It  was  disbanded  in  1973. 

Critical  Incident  (technique) 

A means  of  eliciting  information  in  a survey  by  asking  the  respondent 
about  a specific  event  with  which  he  was  Involved. 

CRT 


See  Cathode  Ray  Tube. 

Currency  (of  information) 

The  up-to-dateness  of  the  information.  Generally  refers  to  the  length  of 
time  between  when  a piece  of  research  was  performed  and  w^ien  information  about 
the  recearch  is  made  available. 


Current  Awareness  Bibliographies 


A DDC  service  which  provides  bi-weekly  bibliographies  of  citations  for 
documents  in  specific  subject  areas  announced  in  the  current  TAB  issues,  accord- 
ing to  user  subject  interest  "profiles." 

DDC  Digest 

A four-page  DDC  publication  distributed  automatically,  at  intervals  of 
between  one  and  two  months,  to  all  established  users  of  DDC,  to  announce  plans, 
changes  in  service,  and  other  developments  in  the  scientific  and  technical 
information  field. 

Defense  R6J)  of  the  1960  *s 


A list  of  DDC  technical  reports  (with  indexes)  accessioned  during  1960-1969, 
available  as  a publication  or  on  magnetic  tape  (with  abstracts)  or  on  reel 
microfilm  (without  abstracts). 

Defense  R&D  of  1970 


A list  of  DDC  technical  reports  accessioned  during  1970,  available  as  a 
publication,  on  magnetic  tape,  or  on  reel  microfilm. 

Demand  Service 


An  information  service  which  provides  Information  (data  or  document)  in 
response  to  a specific  request.  Also  called  Request  service.  (Contrast: 
Subscription  service) 

Departmental  Collection 

A collection  of  documents  or  information  files  retained  by  the  respondent's 
organizational  department  and  kept  in  one  location. 

Dial-Up  (Communications  service) 

Data  transmission  service  via  telephone  communications  lines.  Charge 
is  made  on  a second'i-of-use  basis,  similar  to  long  distance  telephone  service. 
(Contrast:  Leased  line) 

Distant  Library 

A library  or  information  center  which  is  located  more  than  a short  distance 
from  the  respondent.  (Contrast:  Local  library) 

Document 

A piece  of  textual  information,  such  as  a book,  technical  report,  letter. 
Journal  article.  (A  document  can  exist  In  hard  copy,  microform,  or  other  media.) 


DRIT 


Defense  Retrieval  and  I^ndexlng  Terminology.  The  official  published  list- 
ing of  the  DDC  Natural  Language  Data  Base  (NIDB),  a natural  language  technical 
vocabulary  of  unique  terms  extracted  from  technical  summaries » titles  and 
abstracts,  and  used  to  automatically  and  manually  Index  DDC  data  bases. 

DRIT-H 


Defense  Retrieval  indexing  Terminology  Hierarchy.  An  alphabetical  ? '.4t- 
Ing  of  the  DRIT  vocabulary  terms  displayed  with  their  hierarchical  relationships 
to  other  main  terms  within  the  Natural  Language  Data  Base,.  (See  also  DRIT) « 

DROLS 


The  Defense  jWT&E  ^-Llne  ^stem.  A service  whereby  a DDC  users  ms;  query 
any  of  several  DDC  data  banks  (technical  reports,  WUI£,  and  R&B  Program  Planning 
data  bank)  by  means  of  an  on-line  terminal  connection  cons.'.stlng  of  a cathode 
ray  tube  (CRT)  display  device  with  a keyboard  and  attached  printer.  Also  called 
the  RDT&E  On-Line  System.  (Contrast:  Report  bibliography  service) 

Extrapolation 


The  process  of  Inferring  a future  trend  from  an  observid  series  of  events 
occurring  over  a period  of  time. 

Fact  (services) 

A type  of  Information  service  which  provides  Information  In  the  form  of 
data  (usually  numeric)  or  an  answer  to  a specific  question.  (Contrast:  Biblio- 

graphic service) 

Formal  Source  of  Information 


A source  such  as  library  or  an  Information  analysis  center  which  Is  set 
up  a priori  In  a formal  manner  to  provide  Information  to  a general  or  specific 
set  of  potential  users.  (Contrast:  Informal  source  o'f  Information) 

Format  (of  Information) 

The  physical  arrangement  In  which  information  la  presented,  e.g.,  In  a book, 
journal,  technical  report,  abstract  bulletin. 

Friend,  Peer.  Associate 

A professional  or  otherwise  technically  knowledgeable  person  who  Is  known  to  the 
respondent.  (Frequently  a co-worker). 


Hard  Copy 

The  print  medium.  Paper  copy. 


information  Analysis  Renter.  A data  gathering  and  dissemination  center, 
similar  to  a library,  but  which  specializes  In  a narrow,  highly  technical  sub- 
ject area,  and  provides  authoritative  data  review,  evaluation,  and  synthesis  In 
that  subject  area. 

Independent  Variable 

A variable,  or  condition,  which  Is  not  dependent  on  other  variables,  l.e., 
representing  a condition  which  does  not  change  as  a fun_clon  of  other  variables 
being  considered. 

Informal  Source  of  Information 

A source  of  information  not  formally  set  up  and  not  generally  available 
to  a wide  audience,  e.g.,  a personal  or  departmental  collection  of  documents, 
casual  conversations  with  colleagues,  etc.  (Contrast:  Formal  source  of  Informa- 

tion.) 

Information 


Knowledge  or  Intelligence  communicated  or  received. 

In-house  Library 

A library  or  Information  center  which  is  a part  of  the  respondent’s 
organization;  or,  which  is  administered  from  outside  the  organization,  but 
located  on  the  organization's  property  and  available  to  that  organization's 
personnel.  Also  called  Local  library.  (Contrast:  Distant  library) . 

Intermediary  ( In  information  service) 

A person  such  as  a librarian,  search  specialist,  or  terminal  operator 
who  procures  information  and  makes  It  available  to  a requestor  or  user. 

IR&D 


independent  Research  and  Development.  A data  bank  of  research  Information 
performed  by  industrial  organizations,  not  wholly  funded  by  the  DoD. 

Key  Users  (of  DDC) 

The  200  user  organizations  (out  of  a total  of  2,886  user  organizations) 
vdtich  order  the  most  technical  reports  in  a given  year.  (This  Is  taken  as  an 
index  of  use).  (Contrast:  Non»Kev  Users) 

Leased  Line  (Communications  service) 

Data  transmission  service  via  a communication  line  installed  specifically 
for  a given  customer.  Charge  is  made  on  a monthly  basis  depending  on  the  dls> 
tance  between  end  points  of  the  communication  line.  Also  called  "private  line" 
or  "dedicated  line."  (Contrast:  Dial-up) 


Least  Squares 


A statistical  method  of  fitting  a line  to  a set  of  points  on  a graph  in 
such  a way  that  the  sum  of  the  distances  of  the  points  from  the  line  is  a 
minimum. 

Local  Library 

A library  or  information  center  which  la  a part  of  the  respondent's  organ- 
ization and  located  at  reasonable  proximity  to  the  respondent's  office  or 
laboratory,  or  which  is  administered  from  outside  the  organization,  but  located 
on  the  organization's  property  and  available  to  that  organization's  personnel. 
Also  called  In-house  Library.  (Contrast:  Pis cant  Library). 

Management  (personnel) 

Personnel  performing  predominantly  supervisory  or  managerial  activities 
(Contrast:  Bench  level  personnel) . 

Mechanized  Information  Service 

An  information  service  in  which  a query  or  search  is  made  of  one  or  more 
data  banks  by  means  of  a computer,  and  which  produces  as  output;  data,  document 
citations,  or  abstracts. 

Medium  (of  Information) 

The  way  in  which  information  appears,  e.g.,  in  print,  on  microfilm,  on  a 
computer  printout. 

Microfiche 


An  information  medium  in  the  form  of  a series  of  reduced  photographic 
images  in  rows  on  a piece  of  film  about  4"x  6"  square,  which  can  be  enlarged 
(by  means  of  a microfiche  reader/printer)  for  viewing  or  printing. 

Microfilm  (roll  film) 

An  information  medium  in  the  form  of  a strip  of  film,  usually  16  nn  wide 
bearing  a photographic  record  on  a reduced  scale  of  printed  or  other  graphic 
matter,  that  can  be  enlarged  (by  means  of  a microfilm  reader/printer)  for 
viewing  or  printing. 

Microform 


A generic  term  for  the  various  Information  media  in  which  printed  or 
graphic  matter  is  recorded  in  photographically  reduced  form,  and  may  be  enlarged 
for  viewing  or  printing.  Includes  Microfilm.  Microfiche,  microcards,  and  aper- 
ature  cards. 


Modal  Score 


The  quantity  that  occurs  most  frequently  in  a set  of  varying  quantities 
(Compare:  Average) . 


Multiple  Regression  Analysis 

A type  of  statistical  analysis,  used  in  analysis  of  the  results  of  this 
survey,  which  considers  a number  of  Independent  variables  characteristic  of 
the  population  and  determines  which  of  these  is  most  highly  related  to  the  way 
In  which  survey  respondents  differed  In  their  answers  to  survey  questions. 

Non-Key  Users  (of  DDC) 

User  organizations  which  do  not  fall  Into  the  top  200  user  organizations  In 
terms  of  the  quantity  of  technical  reports  ordered  in  a given  year.  (Contrast: 

Key  users) . 

Non-User  (of  DDC) 

An  Individual  member  of  a DDC  user  organization  who  has  not  knowingly 
used  a DDC  service  within  the  past  few  years. 

i 

NTIS  j 

National  Technical  information  Service,  A government  agency  within  the  | 

U.S.  Department  of  Commerce  which  is  responsible  for  the  public  distribution  I 

and  sale  of  Government-sponsored  research,  development,  and  engineering  | 

documents  prepared  by  Federal  agencies,  their  contractors,  and  grantees,  | 

On-Line  Remote  Information  Service  j 

■ — — . , ■ , 

' ( 

A computerized  information  service  In  which  a user  may  communicate  directly  | 

with  the  computer  to  perform  a search  or  query  (or  submit  Input)  by  means  of  a 
keyboard  at  a location  at  any  distance  from  the  computer  itself,  but  hooked  up 
the  computer  via  telecommunication.  A CRT  (cathode  ray  tube)  and  a printer 
, ’,y  also  be  present  with  the  keyboard. 

»rsonal  Collection 

A collection  of  documents  or  Information  files  belonging  to  the  respondent 
and  kept  in  his  office  or  laboratory. 


Program  Planning  Information  System 

A DDC  service  in  which  descriptions  of  RSJ)  projects  planned  by  DoD  ' 
organizations  are  made  available  in  the  R&D  Program  Planning  Data  Bank.  Input 
is  made  on  DD  form  163A. 

Quality  (of  information) 


The  technical  quality  of  Information,  Including  accuracy,  relevance  and 
organization. 


Quantity  (of  information) 


The  amount  of  information,  Including  amount  of  documents  and  amount  of  data. 

RDT&E  On-Line  System 
See  DROLS 
RDT&E  (Program) 

Research,  Development,  Test,  and  Evaluation  Program.  The  DoD's  defense 
research  program. 

Referral  Service  (DDC) 

A DDC  service  providing  names  of  sources  beyond  DDC  of  Government-sponsored 
scientific  and  technical  information  services  not  available  in  DDC  (e.g.,  infor- 
mation analysis  centers,  laboratories,  audiovisual  depositories,  etc). 

Remote  On-Line  Service 


See  On-Line  Remote  Information  Service. 

Report  Bibliography 

A bibliography  (in  the  form  of  a DDC  document) resulting  from  a tailor-made 
literature  search  on  a particular  subject,  performed  in  batch  mode  at  the  request 
of  a user.  (Contrast:  DROLS) 

Report  BibltoRraphy  on  Magnetic  Tape  (RBMT) 

A bibliography  in  machine  readable  form  (on  magnetic  tape)  resulting  from 
a DDC  tailor-made  literature  search  on  a particular  subject,  performed  in 
batch  mode  at  the  request  of  a user.  (Compare:  Report  Bibliography) 

Request  Service 

* 

An  information  service  which  provides  Information  (data  or  document)  in 
response  to  a specific  request.  Also  called  Demand  service.  (Contrast:  Sub- 

scription service) . 

Respondent 

A person  interviewed  as  part  of  this  Survey. 

Response  Time  (of  information) 

The  elapsed  time  between  a person's  request  for  information  and  the  arrival 
of  the  requested  information.  (Sometimes  called  "turnaround  time") 

RBMT 


See  Report  Bibliography  on  Magnetic  Tape. 


Retrospective  Service 


A service  providing  Information  (usually  In  the  form  of  documents,  cita- 
tions, or  abstracts)  that  was  originally  published  during  a specified  past 
period  of  time. 

Scheduled  Bibliography 

A bibliography  (In  the  form  of  a DDC  document)  resulting  from  a PDC 
literature  search  of  a specific  subject  of  current  or  anticipated  Interest. 
(These  are  not  dependent  on  user  requests.  Contrast:  Report  Bibliography 


Selective  Dissemination  of  Information 


A type  of  Information  service  In  which  Information  Is  provided  on  a 
continuing  basis  according  to  previously  registered  subject  interest  categories. 

Selective  Dissemination  of  Information  Software  Packages 

A set  of  five  machine- Independent  computer  programs  available  from  DDC 
for  user  organizations  to  be  used  on  the  TAB  on  tape  data  base,  to  produce 
bibliographies  for  Individual  users  according  to  their  Individual  subject 
profiles.  (See  also:  Selective  Dissemination  of  Information) 

Source  (of  Information) 

The  physical  location  the  respondent  goes  to  to  find  information,  e.g., 
local  library,  personal  collection,  distant  library. 

Standard  Deviation 


A statistical  concept  designating  a measure  of  variability  around  a point 
representing  the  average  of  a given  series  of  quantities.  All  the  Individual 
deviations  from  the  average  are  squared,  then  averaged.  The  square  root  of 
this  quantity  Is  called  the  "standard  deviation." 

S&TI 

Scientific  and  Technical  I^nformatlon.  (Also  referred  to  as  STINFO) 
Subscription  Service 

An  information  service  which  can  be  obtained  by  requesting  it  once,  but 
which  provides  information  on  a continuing  basis,  e.g.,  journal  subscriptions, 
selective  dissemination  of  information. 

Support  (personnel) 

Personnel  in  occupations  providing  information  support  services,  e.g., 
technical  librarians,  information  scientists,  and  terminal  operators. 


TAB 


Technical  ^street  Bulletin.  A bi-weekly  DDC  publication  which  provides 
citations  and  abstracts  of  new  classified  and  limited  DDC  reports.  Indexes 
to  TAB  are  cumulated  quarterly  and  annually. 

Technical  Report  Program 

A DDC  program  in  which  technical  reports  produced  by  Defense  facilities 
and  their  contractors  are  accessioned,  processed,  and  made  available  to  DDC 
users . 

User  (of  DDC) 

An  individual  member  of  a DDC  user  organization  who  has  knowingly  used 
a DDC  service  within  the  past  few  years. 

User  Feedback  System 

A system  of  obtaining  from  a given  group  of  people  on  a regular  basis  data 
about  their  Information  wants,  needs,  and  problems. 

Variance 


The  square  of  the  standard  deviation,  l.e.,  the  average  of  the  squares  of 
the  deviations  from  the  average  point  of  a frequency  distribution.  (Compare: 
Standard  deviation) . 

WUIS 


The  Research  and  Technology  Work  Unit  _Information  ^stem.  A DDC  service 
producing  a collection  of  technically  oriented  summaries  describing  research 
and  technology  projects  currently  in  progress.  Input  is  made  on  Form  1498. 
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Predicted  DoD  S&TI/RDT&E  Management  Information  Environment 
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A. 


DETAILED  METHODOLOGY 


In  order  to  gather  the  Information  necessary  for  this  forecasting 
study,  AUERBACH  and  its  subcontractor,  CRITERION  DEVELOPMENT  ASSOCIATES  (CDA) , 
used  a combination  of  the  techniques  of  telephone  interviewing  and  mailed  question- 
naires. The  methodology  consisted  of  three  steps: 

(a)  Drawing  the  sample 

(b)  Development  of  the  interview  schedule  and  conduct  of  the 
Interviews 

(c)  Data  analysis  and  Interpretation  of  results 

A.l  Drawing  of  Sample 

The  exact  size  of  the  population  surveyed  in  this  study  is  not  known, 
because  the  Defense  Documentation  Center's  records  describe  only  user  organiza- 
tions, rather  than  individual  users.  The  best  estimate  of  the  total  number  of 
individual  users,  however,  is  150,000.  They  are  affiliated  with  2,886  user  organlza 
tions. 


A stratified  sampling  plan  with  random  sampling  within  strata  was 
followed  in  order  to  ensure  a representative  sampling  plan  and  minimize  bias  in 
the  resulting  sample.  The  population  of  user  organizations  was  stratified  as 
follows : 

(a)  Step  One 

(1)  DoD  - Key  user  organizations^ 

(2)  DoD  organizations  - Non-key  user  organizations 

(3)  Contractor  organizations  - Key  users 

(4)  Contractor  organizations  - Non-key  users 

(b)  Step  Two 

(1)  Bench  Level  Personnel 

(2)  Management  Personnel 

(3)  Support  Personnel^ 

1 Key  user  organizations  are  those  which  rank  in  the  top  200  in  terns  of  ordering 
technical  reports  from  DDC.  Non-key  organizations  are  the  remaining  2,686. 

2 "Support  personnel"  are  defined  as  librarians,  information  specialists,  terminal 
operators,  etc. 


(c)  Step  Three 


(1)  Individual  users  of  DDC 

(2)  Individuals  who  do  not  use  DDC 

At  Step  One,  the  2,886  user  organizations  were  divided  Into  the  four 
groups  listed  above.  Then  a random  sample  of  twenty-five  organizations  was  drawn 
from  each  group.  Backups  were  Included  In  this  number  to  ensure  adequate  sampling 
In  the  case  of  non-cooperation. 

At  Step  IWo,  Initial  contacts  were  made  by  the  Interviewers.  For  each 
organization  in  the  sample,  they  contacted  the  Individual  who  was  listed  In  DDC 
records  as  the  "focal  point".  A specially  designed  procedure  was  utilized  to 
obtain  a random  sample  of  twenty  of  the  staff  members  involved  in  R and  D in  each 
organizations. 

Step  Three  divided  survey  participants  Into  users  of  DDC  and  non-users. 
This  information  was  obtained  during  the  Interview,  and  was  not  available  prior 
to  that  time. 

The  procedure  outlined  above  was  designed  to  produce  650-800  interviews 
with  a maximum  of  200  In  each  group  listed  at  Step  One.  This  sample  size  was 
chosen  In  order  to  assure  a confidence  level  of  95%  for  the  percentages  obtained 
In  the  survey.  The  chances  are  95  in  100  that  the  sampling  error  associated  with 
survey  results  will  be  +4  percentage  points  or  less. 

A. 2 Development  of  the  Interview  Sc^edule  and  Conduct  of  the  Interviews 

AUERBACH  and  CDA  developed  a unique  methodology  specifically  for  this 
contract.  Survey  respondents  were  Initially  contacted  by  phone,  asked  to  parti- 
cipate, scheduled  for  an  Interview  and  then  sent  a packet.  The  packet  Included 
a set  of  cards  that  provided  the  response  alternatives  for  a majority  of  the 
questions  in  the  Interview.  These  cards  vastly  reduced  the  problems  of  recency 
effect  and  response  set  so  often  encountered  when  sc&'uctured  responses  are  obtained 
over  the  telphone. 

This  Interview  methodology  combined  the  advantages  of  both  telephone 
Interviewing  and  the  mailed  questionnaire,  while  simultaneously  eliminating  the 
disadvantages  of  both. 
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The  Interview  schedule  was  highly  structured  In  order  o ensure 

maximum  consistency  and  reliability  among  interviews.  The  interview  schedule 

used  for  the  bench  level  and  management  personnel  contained  194  questions. 

Support  personnel  have  different  information  needs  and  use  patterns  than  do 

managers  and  bench  personnel,  hence,  a separate  interview  schedule  was  constructed 

3 

for  them,  which  consisted  of  159  questions. 

Interviewer  training  sessions  were  conducted  at  the  outset  of  the 
project,  and  follow-up  sessions  were  held  to  discuss  problems  and  questions.  During 
the  interviewing, thirty-one  interviews  (just  over  4?)  were  monitored  unobtrusively 
in  order  to  assure  quality  control  and  establish  interjudge  reliability.  Inter- 
judge reliiblllty  coefficients  were  computed  between  the  monitor  and  the  interviewer 
for  each  of  the  31  interviews  that  were  monitored.  Percentage  of  agreement  ranged 
from  84Z  - 97%,  with  an  average  percentage  of  agreement  for  all  31  pairs  of  93.2%. 

A. 3 Data  Analysis 

The  analysis  of  the  data  for  this  project  proceeded  in  three  phases; 

(a)  Identification  of  major  Independent  variables  of  Interest 
(e.g.,  DDC  user  vs.  non-user) 

(b)  Determination  of  significant  effects  of  Independent  variables 
on  dependent  variables  (e.g.,  preferred  media). 

(c)  Identification  and  prediction  of  future  trends  in  the  DoD 
S&TI/RDT&E  management  information  envlornment. 

A. 3.1  Identification  of  Major  Independent  yariablcs  of  Interest 

In  this  study,  there  are  dozens  of  potentla..ly  significant  Independent 
variables  that  define  the  preferences,  attitudes  and  behaviors  exhibited  by  the 
respondents  in  their  information  search  strategies.  In  order  to  identify  those 
variables  that  are  the  best  predictors  of  variability  in  the  responses  to  questions 
in  the  interview,  a series  of  multiple  regression  analyses  were  performed  to  identi- 
fy the  major  variables  to  be  utilized  at  the  second  phase  of  the  analysis. 


See  R&D  Contract  Status  Report;  Survey  Plan  (AUER-2325/2326-100-TR-1,  August 
15,  1975)  for  complete  details  on  the  methodology,  the  sampling  plan  and  the 
interview  achedules. 
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A.3.2 


Determination  of  Significant  Effects  of  Independent  Variables  on 
Dependent  Variables 


Analysis  of  variance  and  contingency  analysis  were  performed  on  each 
of  the  quantifiable  Interview  questions  to  identify  the  interview  questions  that 
can  be  accounted  for  (at  a significance  level  of  p^O.05)  In  terms  of  one  or  more 
of  the  Independent  variables  in  this  study. 

A. 3. 3 Identification  and  Prediction  of  Future  Trends  in  the  S&TI/RDT&E 

Environment 

This  third  step  in  the  analysis  conslst'ed  of  two  parts,  both  of  which 
were  designed  to  provide  an  empirical  basis  for  forecasting. 

(a)  Trend  analysis  was  performed  on  the  respondents'  answers  to 
questions  about  various  aspects  of  sen'lces  in  1970,  1975,  and 
1980. 

(b)  Curve  fitting  was  conducted  using  the  method  of  least  squares 
to  predict  future  problems  and  to  predict  future  demand  for 
various  DDC  services. 


Description  of  the  Survey  Sample 

The  sample  will  be  described  first  in  terms  of  the  four  indepen- 
dent variables  used  to  stratify  the  sample.  Then  its  characteristics  will  be 

described  in  terms  of  the  four  additional  independent  variables  in  the  multiple 

regression  analyses. 

Variables  used  to  stratify  the  sample 

(a)  Contractor  versus  DoD  organizations:  There  are  326  respondents  in  the 

survey  working  for  contractors  and  372  working  for  DoD  agencies.  The 
split  was  46.7%  versus  53.37.. 

(b)  DDC  users  versus  non-users:  Slightly  over  3 out  of  every  4 survey 

respondents  are  DDC  users  (77.97.  versus  22.17.). 

(c)  Key  user  organizations  versus  non-key  organizations:  There  are  441 

respondents  working  in  key  organizations  and  257  respondents  in  non-key 
organizations  (63.27.  and  36.87.  respectively). 

(d)  Bench  level  vs.  Support  vs.  Management:  94  support  personnel  are 

Included  in  the  sample  as  respondents,  accounting  for  13.57.  of  its  over- 
all size.  Bench  level  researchers  number  235,  accounting  for  33.77.  of 
the  sample,  while  management  personnel  accou.it  for  369  or  52.87.  of  the 
sample. 

Additional  variables  describing  the  sample 

(a)  Highest  degree  obtained:  The  most  common  degree  level  obtained  by 

survey  respondents  is  the  bachelor's  degree,  earned  by  274  or  39.37.. 

The  roaster's  degree  is  the  highest  degree  obtained  by  210  or  30.17., 
while  119  hold  the  Ph.D.  (17.1%).  Numerous  respondents  report 
additional  credits  beyond  the  degree  levels  they  indicated.  The  small 
number  of  Ph.D.'s  should  be  noted. 

(b)  Security  Classification:  Nearly  seven  out  of  10  respondents  (69.67.) 

report  Secret  classification,  while  23.1%  report  Top-secret,  only  2.3% 
report  Confidential  and  57.  report  no  classification. 

(c)  Years  of  Experience:  The  average  number  of  years  of  experience  in  R6J> 
for  survey  respondents  is  14.10.  The  shape  of  the  distribution  was 
roughly  normal,  with  approximately  two-thirds  falling  between  five  years 
and  twenty-three  years. 

(d)  Hours  per  week  engaged  in  research:  The  average  number  of  hours  per 

week  that  survey  respondents  report  they  were  engaged  in  research  is 
23.69.  The  distribution  is  bimodal,  however,  with  127  respondents 
reporting  40  hours. 


(e)  COSATl  Fields:  The  majority  of  the  bench  level  and  management  survey 
respondents  work  in  the  hard  sciences  with  emphasis  on  applied  aspects. 
The  four  major  fields  respondent]  report  most  often  were  in  order: 
Electronics /Electrical  Engineering,  Mechanical/lndu.>>trial/Clvil/Marine 
Engineering,  Physics,  Navigation/Communications/Detection  and  Counter- 
measures. Data  from  99  respondents  are  missing  because  the  Support 
personnel  were  not  asked  to  choose  a COSATl  field.  Six  others  did  not 
answer  this  question. 
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TABLE  B-1 


Description  of  Sample: 
Number  of  Respondents  In 
Each  User  Category 


User  Categories 

Respondents 

Percentage 

Respondents  In  Contractor  Organizations 

326 

46.7% 

Respondents  In  DoD  Organizations 

372 

53.3% 

698 

100.0% 

DDC  Users 

544 

77.9% 

Non-Users 

154 

22.1% 

698 

100.0% 

Respondents 

In  Key  Organizations 

441 

63.2% 

Respondents 

In  Non-Key  Organizations 

257 

36.8% 

698 

100.0% 

Bench  Level  Respondents 

235 

33.7% 

Support  Level  Respondents 

94 

13.5% 

Management  Level  Respondents 

369 

52.8% 

698 

100.0% 

High  School  Degree 

30 

4.3% 

2 Year  Degree 

17 

2.4% 

Bachelors  Degree 

274 

39.3% 

Masters  Degree 

210 

30.1% 

Ph.D. 

119 

17.1% 

Missing  Data 

48 

6.8% 

698 

100.0% 
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TABLE  B-1 
(Continued) 


User  Categories 


Respondents 


Percentage 


23.1% 

69.6% 

2.3% 

5.0% 

100.0% 


Average  Years  Experience  (N  = 698)  14.10 

Standard  Deviation  8.86 


Top  Secret 

161 

Secret 

486 

Confidential 

16 

No  Classification 

35 

698 

Hours  Per  Week  in  Research  (N  = 604)*  23.69 

Standard  Deviation  16.17 

Modal  Score  40  (N  = 127) 


■^Does  not  include  Support  Personnel 
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Table  B-3 


Number  of  Respondents  Selecting  Various 
COSATI  Fields  as  Their  Major  Areas  of  Specialization 


COSATI  Fields 


Respondents 


Percentage 


Electronlcs/Electrlca  1 Eng  Ineerlng 
Mechanlcal/Industrlal/Clvll/Marlne 

107 

15.3% 

Engineering 

61 

8.7% 

Physics 

Navlgatlon/Communlcatlons/Detectlon/ 

58 

8.3% 

Countermeasures 

51 

7.3% 

Aeronautics 

44 

6.3% 

Ordnance 

40 

5.7% 

Military  Sciences 

38 

5.4% 

Materials 

29 

4.2% 

Mathematical  Sciences 

26 

3.7% 

Behavloral/Soclal  Sciences 

23 

3.3% 

Propulsion  and  Fuels 

21 

3.0% 

Blologlcal/Medlcal  Sciences 

20 

2.9% 

Missile  Technology 

17 

2.4% 

Chemistry 

14 

2.0% 

Atmospheric  Sciences 

11 

1.6% 

Nuclear  Science/Technology 

10 

1.4% 

Earth  Sciences/Oceanography 

7 

1.0% 

Energy  Conversion 

7 

1.0% 

Methods  and  Equipment 

7 

1.0% 

Space  Technology 

5 

.7% 

Agriculture 

2 

.3% 

Astronomy/Astrophysics 

1 

.1% 

i 


i 


[Support  personnel  and  Missing  Data  99 

698 


14.1%  J 
99.  8%* 


*Roundlng  errors 


TABLE  C-1 


Number  and  Percentage  of 
Respondents  Choosing  Various 
Sources  as  Most  Preferred 


SO!»RCES 

In-house  Library 

Department  Collection 

Personal  Collection 

Friend,  Peer,  Associate 

Mechanized  Information  Service 

Distant  Library 

Consultant 

Supervisor 

Publisher,  Bookstore 
Somlnars/Meet Ings/Conf erences 
Other 


NUMBER  OF  RESPONDENTS 

PERCENTAGE 

306 

50.77. 

80 

13.27. 

79 

13.17. 

43 

7.17. 

21 

3.47. 

14 

2.37. 

6 

1.07. 

2 

.37. 

1 

.27. 

0 

0.07. 

53 

8.77. 

604* 

100.07. 

^Does  not  Include  Support  personnel 
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Table.  C-2 

Summary  of  Preferences  for  Various  Formats 
Including  Effects  of  Independent  Variables 
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♦Interpret  as  follows:  Fewer  Doctorates  preferred 

Technical  Reports  than  Masters 
and  Bachelors  level  researchers 


Table  C-3 


Number  and  Percentage  of  Respondents  Choosing 
Various  Media  as 
Most  Preferred 


Media 

Resnondents 

Percentage 

Prii  ted  Documents 

588 

84.2% 

Verbal  Communication 

51 

7.3% 

Microfiche 

20 

2.9% 

Computer  Printouts 

19 

2.7% 

Microfilm 

11 

1.6% 

Charts 

2 

.3% 

Punched  Cards 

1 

.1% 

Magnetic  Tape 

1 

.1% 

CRT 

1 

.1% 

Other 

4 

.6% 

698 

99.9%* 

♦Rounding  errors 
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Rounding  errors 


Number  of  DDC  Users  Who  Reported  Awareness  of 
Various  DDC  Subscription  Services  and  Number  Who 
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TABLE  C-6 


Percentages  of  DDC  Users  In  Bench  Level, 
Support  and  Management  Categories 
Who  Beported  Awareness  of 
DDC  Demand  Services* 


DDC  Services 

Support 

Bench 

Mcmt 

Technical  Report  Program 

85.22 

44.6% 

47.3% 

Report  Bibs 

79.5% 

36.7% 

41  ,2% 

Scheduled  Bibs 

78.4% 

17.5% 

20.1% 

R&T  Work  Unit  Info  System 

75.0% 

16.9% 

21.9% 

DRIT  . 

73.9% 

3.9% 

10.4% 

RDT&E  On  Line 

63.6% 

11.9% 

17.6% 

DRIT-H 

63.6% 

2.3% 

7.9% 

DDC  Referral  Services 

63.6% 

10.7% 

25.8% 

Defense  R&D  of  the  60 's 

59.1% 

1.7% 

9.3% 

IR&D 

56.8% 

7.3% 

19.9% 

R&D  Program  Planning 

51.1% 

13.6% 

17.6% 

RBMT 

46.6% 

1.7% 

7.5% 

Current  Awareness 

38.6% 

2.3% 

5.2% 

* N = 544 
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TABLE  C-7 


Percentages  of  ODC  Users  In  Bench 
Level,  Support,  and  Management 
Categories  Who  Reported  Awareness 
of  DDC  Subscription  Services* 


DDC  SERVICES 

SUPPORT 

BENCH 

MGMT 

TAB 

88.67. 

43.37. 

44.37. 

DDC  Digest 

85.37. 

14.37. 

25,57. 

ADD 

77.57. 

6.87. 

18.47. 

Current  Awareness 

Bibliographies 

7C.67, 

11.47. 

13.87. 

TAB  on  Tape 

54.47. 

5.77.  - 

6.07. 

Recurring  Reports 

(WUIS) 

53.97. 

2.87. 

7.77. 

Selective  Dissemination  of 
Information  Software  Pkgs. 

50.57. 

4.57. 

4.97. 

Recurring  Reports 

(IR&D) 

49.47. 

4.67. 

8.57. 

Recurring  Reports 
Planning) 

(Program 

43.77. 

1.77. 

5.37. 

*N  - 54/f 
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N (Overall) 


TABLE  C-9 


Percentages  of  DDC  Users  In  Bench  Level, 
Support  and  Management  Categories 
Who  Have  Used  Various 
Information  Analysis  Centers* 


Information  Analysis  Center 

Support 

Bench 

Mgmt 

Infrared  Information  and  Analysis  Center 

42. OZ 

7.9% 

7.9% 

Metals  and  Ceramics  Information  Center 

39. 7Z 

3.4% 

6.8% 

Shock  and  Vibration  Information  Center 

37. 5Z 

2.3% 

3.2% 

Qhr  Propulsion  Information  Agency 

36.4% 

1.7% 

6.8% 

tii  > L.  ity  Analysis  Center 

aestructlve  Testing  Data  Support 

31.8% 

.6% 

5.0% 

Center 

Thermophyslcal  and  Electronic  Properties 

27.3% 

.6% 

4.3% 

Information  Analysis  Center 

26.1% 

3.4% 

3.6% 

Plastics  Technical  Evaluation  Center 
DoD  Nuclear  Information  and  Analysis 

25.0% 

.6% 

3.2% 

Center 

19.3% 

5.1% 

4.6% 

Mechanical  Properties  Data  Center 

18.2% 

3.4% 

4.3% 

Electronic  Properties  Information  Center 

17.0% 

0.0% 

3.9% 

Tactical  Technology  Center 

13.6% 

0.0% 

2.9% 

Machlnablllty  Data  Center 

10.2% 

.6% 

2.5% 

Radiation  Shielding  Information  Center 
Physical  Data  Group,  Lawrence  Livermore 

9.1% 

0.0% 

.7% 

Laboratory 

USAF  Environmental  Technical  Applications 

7.9% 

2.3% 

1.8% 

Center 

Environmental  Information  Division 

6.8% 

0.0% 

.4% 

(Air  Force) 

6.8% 

1.1% 

2.9% 

Strategic  Technology  Office  Data  Base 
Soil  Mechanics  Information  Analysis 

5.7% 

0.0% 

1.1% 

Center 

Coastal  Engineering  Information  Analysis 

5.7% 

.6% 

1.4% 

Center 

3.4% 

0.0% 

0.0% 

Concrete  Technology  Information  Center 
Hydraulic  Engineering  Information  Analysis 

3.4% 

0.0% 

1.4% 

Center 

Pavements  & Soil  Trafflcablllty  Informa- 

2.3% 

.6% 

.3% 

tion  Analysis  Center 

2.3% 

0.0% 

1.1% 

Chemical  Kinetics  Information  Center 
Data  Collection  and  Processing  Group, 

2.3% 

1.1% 

1.4% 

Scripps  Institution  of  Oceanography 
X-Ray  Attenuation  Coefficient  Information 

2.3% 

.6% 

2.5% 

Center 

1.1% 

.6% 

0.0% 

Institute  of  Polar  Studies 
Bathythermograph  Data  Processing  and 

1.1% 

.6% 

2.5% 

Analysis  Facility 
*N  - 544 
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APPENDIX  n 


PREDICTED  POD  S&TI/RDT&E 
MANAGEMENT  INFORMATION  ENVIRONMENT 


TABLE  D-1 


Percentage  of  Various  Categories  of  Respondents 
Reporting  the  Dimension  of  Information  Service 
For  Which  Future  Change  Would  Be  Most  Useful 


Dimension 

Overall  * 

Bench 

Support 

Mgmt 

Response  Time 

24.9% 

25.3% 

25.3% 

24.6% 

Quality 

24.7% 

24.1% 

14.7% 

28.2% 

Currency 

17.9% 

25.3% 

13.3% 

14.7% 

Amount 

11.2% 

9.8% 

10.7% 

12.3% 

Medium 

9.8% 

4.3% 

28.0% 

7.9% 

Format 

9.6% 

8.6% 

8.  0% 

10.7% 

Combination  of  above 

1.6% 

2.5% 

0.0% 

1.6% 

*N  = 665 


TABLE  D>2 


Annual  Predictions  for 
Automatic  Document  Distribution  - Output 


1976 

420,834 

1977 

459,310 

1978 

497,736 

1979 

536,262 

1980 

574,738 

1981 

613,214 

1982 

651 ,690 

1983 

690,166 

1984 

728,642 

1985 

767,118 

1986 

805,594 

1987 

844,020 

1988 


882,546 


TABLE  D-3 


Annual  Predictions  for 
Current  Awareness  - Output 


1976 

23,933 

1977 

28,833 

1978 

33,733 

1979 

38,633 

1980 

43,533 

1981 

48,433 

1982 

53,333 

1983 

58,233 

1984 

63,133 

1985 

68,033 

1986 

72,933 

1987 

77,833 

1988 

82,933 

Note:  This  prediction  Is  based  upon 

the  assumption  of  unlimited 
availability  of  Current  Awareness 
Bibliographies.  At  present,  this 
Is  an  unannounced,  limited 
availability  service. 
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TABLE  D-4 


Annual  Predictions  for 

Defense  Retrieval  On-Line  System  - Remote  Searches 


1976 

108,640 

1977 

129,600 

1978 

150,640 

1979 

171,640 

1980 

192,640 

1981 

213,640 

1982 

234,640 

1983 

255,640 

1984 

276,640 

1985 

297,640 

1986 

318,640 

1987 

339,600 

1988 

360,600 
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TABLE  D-5 


Annual  Predictions  for 
the  Independent,  Research 
and  Development  Data  Base  - Output 


1976 

1,492 

1977 

1,762 

1978 

2,033 

1979 

2,303 

1980 

2,574 

1981 

2,844 

1982 

3,115 

1983 

3,385 

1984 

3,656 

1985 

3,926 

1986 

4,197 

1987 

4,467 

1988 

4,738 
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TABLE  D-6 


A inual  Predictions  for 
Program  Planning  Reports  - Output 


1976 

598 

1977 

614 

1978 

630 

1979 

646 

1980 

662 

1981 

678 

1982 

694 

1983 

710 

1984 

726 

1985 

742 

1986 

758 

1987 

774 

1988 


790 


TABLE  D-7 


Annual  Predictions  for 
The  Work  Unit  Information  System  - Output 


1976 

16,366 

1977 

17,842 

1978 

19,318 

1979 

20,794 

1980 

22,170 

1981 

23,652 

1982 

25,128 

1983 

26,604 

1984 

28,080 

1985 

29,656 

1986 

31,032 

1987 

32,508 

1988 

33,984 
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TABLE  D-8 


1976 

Annual  Predictions  for 
Changes  In  the  Work  Unit 
Information  System 

129,000 

1977 

140,920 

1978 

152,340 

1979 

164,760 

1980 

176,680 

1981 

188,600 

1982 

200,520 

1983 

212,440 

1984 

224,360 

1985 

236,280 

1986 

248,200 

1987 

260,120 

1988 

272,040 
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